Rates of Convergence for Variable Resolution
نویسنده
چکیده
This paper presents a general method to derive tight rates of convergence for numerical approximations in optimal control when we consider variable resolution grids. We study the continuous-space, discrete-time, and discrete-controls case. Previous work described methods to obtain rates of convergence using general approximators (Bert-sekas, 1987), multi-grid (Chow & Tsitsiklis, 1991) or Random grids (Rust, 1996). These results provide bounds on the error of approximation of the value function as a function of the space discretization resolution (or the number of grid-points) which is assumed to be uniform. Consequently, they do not consider the beneet of using non-uniform resolutions. However, empirical results (Munos & Moore, 1999b) have shown the importance of using variable resolution discretizations, especially for problem of high-dimensional state-space (in order to attack the \curse of dimensionality"). This paper provides some bounds on the approximation error of the value function in terms of the local interpolation error. Additionally, we are able to predict the eeect that locally increasing the grid-resolution has on the global performance of the controller, thus opening a way for designing eecient grid-reenement procedures. This analysis can be applied to stochastic or deter-ministic problems and can be used with many grid interpolators, including grids based on kd-trees, multi-grids, random, or low discrepancy grids.
منابع مشابه
Almost Sure Convergence Rates for the Estimation of a Covariance Operator for Negatively Associated Samples
Let {Xn, n >= 1} be a strictly stationary sequence of negatively associated random variables, with common continuous and bounded distribution function F. In this paper, we consider the estimation of the two-dimensional distribution function of (X1,Xk+1) based on histogram type estimators as well as the estimation of the covariance function of the limit empirical process induced by the se...
متن کاملThe effect of focal spot size on the spatial resolution of variable resolution X-ray CT scanner
Background: A variable resolution X-ray (VRX) CT scanner provides a great increase in the spatial resolution. In VRX CT scanners, the spatial resolution of the system and its field of view (FOV) can be changed according to the object size. One of the main factors that limit the spatial resolution of VRX CT scanner is the effect of the X-ray focal spot. Materials and Methods: A theoreti...
متن کاملAchieving Regional Convergence through the Role of Foreign Direct Investment and Portfolio Investment: Evidence from ASEAN+3
T he purpose of this study is to analyze the effect of foreign direct investment and portfolio investment on the convergence occurrence of economic growth of countries in the ASEAN + 3 region and to determine the time or speed required to achieve convergence. The type of data used in this research is secondary data panel which is combination between time series data and cross-section...
متن کاملA new model of (I+S)-type preconditioner for system of linear equations
In this paper, we design a new model of preconditioner for systems of linear equations. The convergence properties of the proposed methods have been analyzed and compared with the classical methods. Numerical experiments of convection-diffusion equations show a good im- provement on the convergence, and show that the convergence rates of proposed methods are superior to the other modified itera...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2000